Toward the Development of More Robust Policy Models

The current state of the world suggests we have some difficulty in developing effective policy. This paper demonstrates two methods for the objective analysis of logic models within policy documents. By comparing policy models, we will be better able to compare policies and so determine which policy is best. Our ability to develop effective policy is reflected across the social sciences where our ability to create effective theoretical models is being called into question. The broad scope of this issue suggests a source as deep as our unconscious ways of thinking. Specifically, our reliance on modern and postmodern thinking has limited our ability to develop more effective policy, and more particularly, logic models. The move in some quarters toward “integral” thinking may provide insights that support the creation of more useful policy models. However, some versions of that thinking seem to be unwittingly mired in modern and postmodern thinking. This paper identifies how integral thought may be clarified, allowing us to advance beyond postmodern thinking. Usefully, this “neo-integral” form of thinking supports the creation of more mature policy models by encompassing greater complexity and a careful understanding of interrelationships that may be identified within the logic models that are commonly found in policy analyses. Neo-integral thinking is related to more complex forms of systems thinking and both are found in recent conversations within the nascent field of metatheory. And, to some extent, a logic model within a policy operates as a kind of theoretical model because both may be used to inform understanding and decision-making. Therefore, it seems reasonable to apply neo-integral thinking and metatheoretical methodologies to conduct critical comparisons of logic models. In the present paper, these methodologies are applied to critically compare two logic models. The structure of each model is analyzed to objectively determine its complexity and formal robustness. The complexity is determined by quantifying the concepts and connections within each model. The robustness of a model is a measure of its internal integrity, based on the ratio between the total number of aspects and the number of concatenated aspects. In this analysis, one policy model is found to have a robustness of 0.08, while another is found to have a robustness of 0.67. The more robust policy is expected to be much more effective in application. Implications for policy development and policy application are discussed. 1 Steven E. Wallis, Ph.D., received his Ph.D. from Fielding Graduate University in 2006. He has a decade of experience as an organizational development consultant in Northern California and a broad range of interdisciplinary interests. He is the founding director of the Foundation for the Advancement of Social Theory. The goal of F.A.S.T. includes identifying objective paths for the validation of social theory, benchmarking the advancement of theory, and supporting the falsification and application of effective theory in social systems. Through this metatheoretical approach, Dr. Wallis is working to accelerate the advancement of the social sciences for the benefit of scholars and practitioners around the globe. Email: [email protected] Wallis: Toward the Development of More Robust Policy Models INTEGRAL REVIEW  March 2010  Vol. 6, No. 1 Toward Development of Politics and the Political 154 This approach will enable the more conscious advancement of policy through the development of improved logic models and it opens the door for more effective impact of such policies in a political context. From an integral perspective, this paper implies that we should avoid engaging in loosely defined integral thinking that lead to pronouncements about what people “should” do. Instead, this paper shows how to apply a more precise and objective form of neo-integral thinking to empower individuals and organizations to accomplish their most noble goals.